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Abstract 

We review witnesses, an emerging Haskell idiom, and suggest some 
terminology. We then introduce open witnesses as a library, and 
propose an extension to allow the creation of them at top-level. We 
show how this solves the expression problem, all with relatively 
little implementation fuss. 

Categories and Subject Descriptors D.3.3 [PROGRAMMING 
LANGUAGES]: Language Constructs and Features 

General Terms Design, Languages 

Keywords Haskell, witnesses, open witnesses, expression prob- 
lem, extensible data types 

1. Introduction 

Users of object-oriented languages such as Java and C++ will be 
familiar with extensible types under the name subclassing, the 
ability to create a type (a derived class) that extends and existing 
type (a base class). The derived class inherits all the data of the 
base class, and can extend it with additional data of any type. Values 
of the derived class can be (implicitly) converted to the base class 
without loss of this additional data: such values of the base class 
can be examined and recovered as the derived class. 

The Haskell equivalent of this is adding new variants to an 
existing data-type, but despite Haskell's sophisticated type system, 
this is quite hard to do in the general case. It's straightforward to 
do if one restricts the type of the additional data to be stored and 
recovered, at the time "base type" is declared. 

A number of solutions have been suggested for this prob- 
lem (see section 5), most notably the Data.Typeable [1] (and 
Data. Dynamic) modules available in the Haskell standard li- 
braries. But this is unsafe (see section 4.2). The key to the problem 
is dynamically representing, or witnessing, the type to be stored, so 
that it can be matched up and recovered. 

There is already existing work on witnesses. Witnesses (sec- 
tion 2) are values that say something about type-variables. The 
type of the witness defines exactly what can be said about the type 
variables. We're particularly interested in simple witnesses (section 
2.1), witnesses that constrain a type-variable to a single type. Sim- 
ple witnesses can be compared by value, and if the values match, 
we can return a proof of type identity, itself an equality witness. 

matchWitness :: 

Witness a — > Witness b —> Maybe (EqualType a b) 



Simple witness types for closed systems of types can be defined 
with GADTs (section 2.2), though it is possible to do so without 
GADTs (section 2.5). And if we have a witness type for its ele- 
ments, we can create a witness type for HList-style lists (section 
2.7). We can also create witness types that reify class instances 
(section 2.4), so we can pass them around as values. 

Our contribution is open witnesses (section 3), simple witnesses 
that can witness to any type, but can only be generated in the 10 
monad (and another OW monad we define for that purpose). 

newIOWitness :: 10 (IOWitness a) 

With open witnesses one can create open dictionaries that are fully 
heterogenous: the same dictionary can store values of any type, 
with matching open witnesses as keys (section 3.2). For instance, 
one can implement the ST monad as a state monad on OW with 
an open dictionary as its state (section 3.3). 

So far, so good; but we're limited in the ways open witnesses 
can be created. But if we extend Haskell to allow open witnesses to 
be declared at top level, with each one unique (section 4), we can 
do a lot more. 

(identifier) :: IOWitness (type) <— newIOWitness 

The combination of fully heterogenous dictionaries and the top- 
level declaration of unique strongly-typed keys to those dictionaries 
gives us many useful things: 

• a safe version of Typeable (section 4.2) 

• extensible data types (section 4.3) and thus a solution to the 
expression problem (section 4.4) 

• idioms for object oriented programming (sections 4.5, 4.6) 

• bindings dictionaries for an extension for thread-local storage 
(section 4.7) 

The purpose of this paper is twofold: to convince Haskell program- 
mers that they want to use open witness declarations, and, relatedly, 
to convince implementers of Haskell that they want to implement 
them. 

2. Witnesses 

A witness is a value that witnesses some sort of constraint on 
some list of type variables. The type of such a value might look 
something like this: 

MyWitness a b c 

The constraint on a, b and c might be anything, depending on 
the value. Perhaps there's a class constraint. Perhaps one of them 
is restricted to a particular set of types. However, we're mostly 
interested in these three categories: 

• simple witnesses constrain a variable to a single type 

• equality witnesses constrain two type variables to be the same 
type 
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• instance witnesses constrain type variables to an instance of a 
type-class. 

Type witnesses are not a new idea, but were one of the first uses of 
GADTs in Haskell. They are used in at least one major Haskell 
project, dares [12]. RepLib [17] introduces representation types 
which are both simple witnesses and what we call representatives 
(section 2.6), but here we separate the two notions. This section of 
the paper is largely a review of existing work. 

2.1 Simple Witnesses and Equality Witnesses 

Simple witnesses constrain a variable to a single type, and they have 
a type of this form: 

MySimpleWitness a 

Here a is the type variable being constrained. Though a might be 
of any kind, throughout we shall examine only simple witnesses to 
types of kind *. 

Sheard et al. [14] show how to match two simple witnesses, to 
provide (if they are equal) a proof of type equality. The principle is 
this: to count as a simple witness type, each value must constrain 
the a parameter to a single type. Accordingly, if two values are 
identical, then they have the same type (though the converse is not 
always true, as we shall see). This means that given two simple 
witnesses of types w a and t» ft,we can compare them to determine 
whether a and b are the same type. If they are the same type, we 
can provide a value of type EqualType a b (an equality witness) 
that proves the equality of a and b. 

This class provides a function matchWitness that accom- 
plishes this: 

class Simple Witness w where 
matchWitness :: 

w a — > w b — > Maybe (EqualType a b) 

The class comes with a constraint. To be a correct instance of 
Simple Witness, all values must match themselves: 

matchWitness wit wit — Just MkEqualType 

Thus with the appropriate implementation, MySimpleWitness 
would be an instance. 

instance Simple Witness MySimple Witness where 

EqualType (Equal in Sheard et al. [14]) is another kind of witness 
type, one that witnesses to the equality of its two type arguments. 
It can be defined straightforwardly with GADTs: 

data EqualType a b where 

MkEqualType :: V t. EqualType t t 

Simply by bringing a MkEqualType into scope, its type parameters 
a and 6 can be unified in any type expression. For instance: 

examplellnify :: 

V a b c. EqualType a b — > (a, b — > c) — > (b, a — > c) 
examplellnify MkEqualType = id 

One cannot construct a MkEqualType of type EqualType a b 
where a and b are different types. One can of course construct 
undefined of type EqualType a b for any a and b, but since 
undefined will not match against MkEqualType, it cannot be used 
to unify a and b. 

Note that the type arguments to EqualType have kind *. We 
could create a similar type for representing proofs of equality of 
type-constructors of any other kind. In practice, we will shoehorn 
these into EqualType where possible. For instance, a proof that / 
and/', two type-constructors of kind * — > *, are identical, can be 
represented with a value of type EqualType (f ()) (/' ()). 



Simple witnesses constrain their parameter to a single type, 
rather than just to an open type expression. For instance, using 
GADTs, one can create a type that includes values that witness only 
to part of a type: 

data MyPartialWitness a where 

MPWMaybe :: V p. MyPartialWitness (Maybe p) 

Here MPWMaybe witnesses the parameter a to Maybe p, but p 
is left unwitnessed. My Partial Witness cannot be made a correct 
instance of Simple Witness and is not a simple witness type. 

2.2 Witnesses with GADTs 

Just as we did for our equality witness type, the easiest way to 
create witness types of all sorts is with generalized algebraic data 
types (GADTs) [11]. Here's an example of a simple witness type, 
where the possible types to be witnessed are represented with 
values: 

data CharOrlnt a where 
IsChar :: CharOrlnt Char 
Islnt : : CharOrlnt Int 

This gives us two witnesses, IsChar and Islnt. They have type 
CharOrlnt Char and CharOrlnt Int, but as constructors both 
pattern-match as CharOrlnt a, unifying a to Char or Int in their 
consequent expression. For instance: 

somechar :: V a. CharOrlnt a — > a 
somechar — A IsChar — > 't' 

The type of the parameter to CharOrlnt can be universally quan- 
tified (V a.) in the type of somechar, but IsChar has the effect of 
binding that parameter to Char in the consequent of the expression, 
't\ 

Since each value of CharOrlnt constrains the type parameter 
a to a single type, we can make it an instance of SimpleWitness: 

instance Simple Witness CharOrlnt where 

matchWitness IsChar IsChar — Just MkEqualType 
matchWitness Islnt Islnt =Just MkEqualType 
matchWitness^- —Nothing 

Our example CharOrlnt covers only two types. However, we can 
create witness types that witness to a system of types: 

data My Type a where 
IsChar v.MyType Char 
Islnt :: My Type Int 

IsMaybe ::V a. MyType a — > MyType (Maybe a) 

IsList ::V a. MyType a — > MyType [a] 
IsPair : : 

V a b. MyType a -» MyType b -» MyType (a, b) 

This covers all types creatable from Char and Int and the type 
constructors [], Maybe and (, ). For instance, a witness to the type 
[Maybe ([Int], Char)]: 

exampleMyType :: MyType [Maybe ([Int], Char)] 
exampleMyType — 

IsList $ IsMaybe $ IsPair (IsList Islnt) IsChar 

We can write matchWitness for MyType to make it an instance 

of Simple Witness: 

instance SimpleWitness MyType where 
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matchWitness IsChar IsChar — 

Just MkEqualType 
matchWitness Islnt Islnt = 

Just MkEqualType 
matchWitness (IsMaybe tp) (IsMaybe tq) — do 

MkEqualType <— matchWitness tp tq 

return MkEqualType 
matchWitness (IsList tp) (IsList tq) = do 

MkEqualType <— matchWitness tp tq 

return MkEqualType 
matchWitness (IsPair tpa tpb) (IsList tqa tqb) — do 

MkEqualType <— matchWitness tpa tqa 

MkEqualType <— matchWitness tpb tqb 

return MkEqualType 
matchWitness^- = Nothing 

2.3 Using Witnesses 

The simplest use of witnesses is to witness the type of a value. We 
provide the type Any to make this easy: 

data Any w — V a. MkAny (w a) a 

Thus the type Any CharOrlnt contains either a Char or an Int: 
it is isomorphic to Either Char Int. 

Any CharOrlnt = Either Char Int 

But witness types are more general than this: they can witness a 
type-variable in any expression. We can generalise Any to take a 
type-constructor: 

data AnyF w f = V a. MkAnyF (w a) (f a) 

Thus we have this isomorphism: 

AnyF CharOrlnt [] Either [Char] [Int] 

Notice how the Char vs. Int choice of type is separated from its 
use as the element type to the [] constructor. This separation is the 
key purpose of witness types. 

2.4 Instance Witnesses 

Yakeley [18] introduces instance witnesses, that reify an instance 
of a class. For example, we can define a Numlnst type that reifies 
instances of the Num class: 

data Numlnst a where 

MkNumlnst :: V a. Num a => Numlnst a 

Any value with a type with a Num constraint can be rewritten to 
take a Numlnst argument instead. Here are (+) and fromlnteger 
as defined in the Prelude: 

(+) :: V a. Num a => a — > a — > a 
fromlnteger :: V a. Num a => Integer — > a 

And here they are rewritten: 

plus' :: V a. Numlnst a — > a — > a — > a 

— Look, no Num constraint! 
plus' MkNumlnst = (+) 

fromlnteger' :: V a. Numlnst a — > Integer — > a 
fromlnteger' MkNumlnst — fromlnteger 

And we can create Numlnst values for any instance of Num: 

intNum :: Numlnst Int 
intNum = MkNumlnst 

2.5 Witnesses without GADTs 

Baars and Swierstra [4] introduced an equality type in 2000, before 
GADTs were well-known: 



newtype Equal a b — Equal (V/. / a — > f b) 

By "plugging in" the appropriate type constructor as /, they showed 
how to use it to convert type-variables in any expression. Indeed 
their Equal is isomorphic to EqualType: 

toEqual :: EqualType a b — > Equal a b 
toEqual MkEqualType = Equal id 
fromEqual :: Equal a b — > EqualType a b 
fromEqual (Equal p) — p MkEqualType 

Sulzmann and Wang [15] show how to convert GADTs into GADT- 
less types by a similar approach of including the general conversion 
function, which we can use to create witness types without GADTs: 



data CharOrlnt' a 

=IsChar(\/f.f a -> / Char) 
Islnt (V/./ a -> / Int) 

2.6 Representatives 

If two simple witnesses have the same value, then they have the 
same type. Now we introduce representatives: type constructors for 
which if they have the same type, then they have the same value. 



simple witness 
value — > type 



representative 
type — > value 



The main benefit of representatives is that we can make them 
instances of a class, so as to avoid passing them around explicitly. 

class Is rep a where 

representative :: rep a 

Simple witnesses defined with GADTs are often also representa- 
tives. The CharOrlnt type we defined in section 2.2, for instance, 
is a representative type: 

instance Is CharOrlnt Char where 

representative — IsChar 
instance Is CharOrlnt Int where 

representative — Islnt 

The simplest representative is the universal representative, Type. 

data Type a — MkType 

Type is useful as a parameter to polymorphic functions when one 
wants to make clear that just the type is being passed to specify 
some class instance dictionary, and not any value. 

class Storable a where 
sizeOf :: Type a — > Int 

The definition is met trivially, since there is only one value in Type. 

instance Is Type a where 
representative — MkType 

2.7 HList-Style List Types 

HList [6] provides strongly-typed heterogenous lists using two 
constructors called HCons and HNil. Given a witness type for 
the elements, we can create a witness type for an HList of those 
elements. 

data ListType w a where 
IsHNil :: ListType w HNil 
IsHCons :: 

w e — > ListType w I ListType w (HCons e I) 
instance Simple Witness w => 
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SimpleWitness (ListType w) 
where 

matchWitness IsHNil IsHNil — Just MkEqualType 
matchWitness 

(IsHCons wel wll) (IsHCons we2 wl2) 
= do 

MkEqualType <— matchWitness wel we2 
MkEqualType <— matchWitness wll wl2 
return MkEqualType 

The type may also have representatives: 

instance Is (ListType w) HNil where 

representative — IsHNil 
instance (Is w e, Is (ListType w) I) => 

Is (ListType w) (HCons e I) 
where 

representative — 

HCons representative representative 

As an example, we can use CharOrlnt from section 2.2 to create 
a witness for lists of Char and Int values. 

charslnts :: Any (ListType CharOrlnt) 
charslnts — 

MkAny representative (HCons 3 (HCons HNil 'a')) 

The type Any (ListType CharOrlnt) contains HList values 
where each element is either a Char or an Int. 

3. Open Witnesses 

As we have shown, using GADTs it is straightforward to create 
a simple witness type for any given finite set of types and type- 
constructors. We now introduce a type for a variety of simple wit- 
nesses we call open witnesses, that can witness any type. However, 
they cannot be constructed: they can only be generated in certain 
monads. 

We present an interface for open witnesses in the 10 monad 
here as the public interface to a library extension: while it is safe to 
use, it requires unsafe functions to implement. 

type 10 Witness a 

instance SimpleWitness 10 Witness 

newIOWitness :: V a. 10 (10 Witness a) 

Unlike the examples of type witnesses we constructed earlier with 
GADTs, 10 Witness does not encode the witnessed type. Instead, 
each has a generated unique value, and the matchWitness func- 
tion matches them by this value. So while two 10 Witness values 
from separate calls to newIOWitness may have the same type, 
matchWitness on them will return Nothing. 

However, if two 10 Witness arguments have the same value, 
then they must be the result of a single call to newIOWitness. 
They must therefore have the same type, and thus it is safe for 
matchWitness to create a MkEqualType for them. 

We also introduce a "runnable" OW monad in which open wit- 
nesses (OpenWitness) can be generated and used. For simplicity, 
we generalise IOWitness as OpenWitness RealWorld. 

data OpenWitness s a 

instance SimpleWitness (OpenWitness s) 

data RealWorld 

type IOWitness — OpenWitness RealWorld 
newIOWitness :: V a. 10 (IOWitness a) 

data OW s a 

newOpenWitnessOW :: V s a. OW s (OpenWitness s a) 
runOW :: V a. (V s. OW s a) -> a 
owToIO :: V a. OW RealWorld a -> 10 a 



The OW monad follows a scheme similar to the ST monad of 
using a type parameter (s) to prevent OpenWitness values (or 
STRef values in ST) unsafely escaping. 

3.1 Implementation 

We believe this open witness API cannot be implemented in safe 
Haskell. However, we can implement it in GHC using various 
unsafe extensions. 

The OpenWitness type and the newIOWitness function 
can be implemented similarly to the Data. Unique module. [2] 
OpenWitness is a newtype of Integer: 

newtype OpenWitness s a — MkOpenWitness Integer 
deriving Eq 

We use unsafePerformlO and the NOINLINE pragma to de- 
clare io WitnessSource as an MVar at top level. By using Integer 
rather than Int, we prevent newIOWitness from rolling over and 
unsafely issuing duplicate values. 

ioWitnessSource :: MVar Integer 

{-# NOINLINE ioWitnessSource #-} 

ioWitnessSource — unsafePerformlO (newMVar 0) 

An IOWitness is an OpenWitness specialised for RealWorld, 
very similar to the ST monad: 

data RealWorld 

type IOWitness — OpenWitness RealWorld 

Our generation function newIOWitness uses ioWitnessSource 
to count out unique values. 

newIOWitness :: V a. 10 (IOWitness a) 
newIOWitness = do 

vol <— takeMVar ioWitnessSource 

putMVar ioWitnessSource (val + 1) 

return (MkOpenWitness val) 

For matchWitness, we compare the Integer values and re- 
turn a MkEqualType if they are equal. We have to create the 

MkEqualType with unsafeCoerce. 

instance SimpleWitness (OpenWitness s) where 
matchWitness 

(MkOpenWitness ua) 
(MkOpenWitness ub) 
= if ua == ub 

then Just (unsafeCoerce MkEqualType) 
else Nothing 

The OW monad is a pure state monad with an Integer state. 

newtype OW s a — MkOW (State Integer a) 
deriving (Functor, Monad, MonadFix) 

The newOpenWitnessOW function creates new OpenWitness 
values with the current state, and then increments the state. 

newOpenWitnessOW :: V s a. OW s (OpenWitness s a) 
newOpenWitnessOW = MkOW 

(State (A val — > (MkOpenWitness val, val + 1))) 

To run computations of the OW monad, we simply run the state 
monad with the initial state of 0. This means that the Open Witness 
values will be unique only within the run that created them. This 
is not a problem, as the s type parameter ensures that witnesses 
cannot escape runOW. 

runOW :: V a. (V s. OW s a) -> a 

runOW uw = (A (MkOW st) — > evalState st 0) uw 

We define owToIO to run computations of type OW RealWorld a 
in the IO monad, and the generated witnesses are thus of type 
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lOWitness. The OW computation modifies the state of our top- 
level MVar, ioWitnessSource. 

owToIO :: OW RealWorld a -> 10 a 
owToIO (MkOW st) = 

modifyMVar ioWitnessSource (A start — > 
let 

(a, count) — runState st start 

in 

return (count, a) 

) 

3.2 Open Dictionaries 

Using OpenWitness it is straightforward to create an open dictio- 
nary type. An OpenDict can store values of any type in the same 
dictionary, indexed by Open Witness keys. While this can be gen- 
eralised to any witness type, we present the API here specifically 
for OpenWitness for simplicity. 

data OpenDict s 
openDictLookup :: 

Open Witness s a — + OpenDict s — > Maybe a 
empty OpenDict :: OpenDict s 
openDictFromList :: 

[Any (OpenWitness s)] — > OpenDict s 
openDictAdd :: 

Open Witness s a — > a — > 

OpenDict s — > OpenDict s 
openDictModify : : 

OpenWitness s a — > (a — > a) — > 

OpenDict s — > OpenDict s 
openDictReplace :: 

Open Witness s a — > a — > 

OpenDict s — > OpenDict s 
type 70 'OpenDict = OpenDict RealWorld 

We choose not to expose any ordering on Open Witness, the type 
of keys of our dictionary, something that will become important 
in section 4. So the performance of look-up for an OpenDict can 
be no better than O(n) as we compare a given key with each 
key in the dictionary in turn. This could perhaps be improved by 
exposing an ordering privately to the OpenDict implementation, 
but for simplicity we show an implementation that uses only what 
is exposed. 

The type is simply a list of cells (key-value pairs), each of type 
Any (OpenWitness s). 

newtype OpenDict s — 

MkOpenDict [Any (OpenWitness s)] 
empty OpenDict = MkOpenDict [] 
openDictFromList — MkOpenDict 

To look up a key, we go through each pair in the dictionary until a 
key matches. 

matchAny :: (SimpleWitness w) => 

w a — > Any w — > Maybe a 
matchAny wit (MkAny emit ca) — do 

MkEqualType <— matchWitness cwit wit 

return ca 

openDictLookup wit (MkOpenDict cells) — 

UstToMaybe (mapMaybe (matchAny wit) cells) 

To add an entry, we simply attach it to the head with the Haskell : 
list construction operator. 

openDictAdd wit a (MkOpenDict cells) = 
MkOpenDict ((MkAny wit a) : cells) 



To modify an entry, we again go through each pair until a key 
matches, and then modify it: 

replaceFirst :: (a — » Maybe a) — > [a] — > [a] 
replaceFirst f (a : aa) — case / a of 

Just newa — + (newa : aa) 

_ — > a : (replaceFirst f aa) 
replaceFirst _ _ = [] 

openDictModify wit f (MkOpenDict cells) = 
MkOpenDict 
(replaceFirst 

((fmap ((MkAny wit) . /)) . (matchAny wit)) 
cells 

) 

openDictReplace wit a — 

openDictModify wit (const a) 

3.3 OW and ST 

Trading one library extension for another, it is possible to build the 
ST monad together with STRef (except for, of course, the unsafe 
functions) using the OW monad. 

Our ST monad type is simply a state monad nesting OW, with 
OpenDict as the state. 

import Control. Monad. State 

type ST s = StateT (OpenDict s) (OW s) 

The basic monad-running functions are straightforward. 

stToOW :: ST s a -> OW s a 

stToOW st — evalStateT st emptyWitnessDict 

runST :: (V s . ST s a) -> a 

runST st = runOW (stToOW st) 

fixST :: (a — » ST s a) — » ST s a 

fix ST = mfix 

stToIO :: ST RealWorld a -> 10 a 
stToIO = owToIO .stToOW 

Our reference type, STRef, is simply our open witness type. 

type STRef = Open Witness 

To create a new reference given an initial value, we generate it with 
newOpen Witness 0 W and store it with the value in the dictionary. 

newSTRef :: a -> ST s (STRef s a) 
newSTRef a = do 

wit <— lift newOpenWitnessOW 

diet <— get 

put (openDictAdd wit a diet) 
return wit 

To read or write a reference, we find it in the dictionary and perform 
the appropriate action on the dictionary entry: 

readSTRef :: STRef s a -> ST s a 
readSTRef key = do 
diet <— get 

case openDictLookup key diet of 
Just a — » return a 
- — » fail " ref not found" 

writeSTRef :: V s a. STRef s a -> a -> ST s () 
writeSTRef key a = 

modify (openDictReplace key a) 

modifySTRef :: 
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V s a. STRef s a -> (a -> a) -> ST s () 
modifySTRef key f = 

modify (openDictModify key f) 

This is not the most efficient implementation. Since we have chosen 
not to make OpenWitness an instance of Ord, we cannot use it as 
a key to a Map. However, it would not be hard to generate such 
keys (say, Int) in the monad and store them in our STRef types. 

4. Open witness declarations 

We now introduce a language extension that would allow the pro- 
grammer to declare IOWitness values at top level. 

(identifier) :: IOWitness (type) <— newIOWitness 

This extension might be generalised to allow other top level 
things such as MVars, but for this paper we restrict ourselves to 
newIOWitness. Simple witnesses declared in this way are guaran- 
teed to be unique, that is to match themselves (with match Witness) 
but not match witnesses from any other declaration or from any ex- 
plicit call to newIOWitness in the 10 monad. 

In the syntax of the Haskell 98 Report[9], we add a new case to 
the topdecl production: 

| pat :: type <— newIOWitness 

The declared type must be equal to IOWitness t, where t is a 
closed type, i.e., where all type-variables have been quantified. 
Informally, foralls, be they explicit or implicit, are not allowed 

outside the IOWitness. 

wl :: IOWitness Int <— newIOWitness 

— OK 

w2 :: IOWitness (V a. 10 a) <— newIOWitness 

— OK if impredicativity is allowed 

w3 :: V a. IOWitness (10 a) <— newIOWitness 

— prohibited, IOa is not closed 

w4 :: IOWitness (10 a) <— newIOWitness 

— prohibited, this is the same as ui3 

While this could be generalised to allow certain other 10 functions 
at top-level (see section 6.2), in this paper we consider only the 
newIOWitness function. 

An extension that allows the running of 10 code at top level 
runs the risk of breaking various assumptions of Haskell. In par- 
ticular, we want to prevent the observation of the order in which 
initialisers are run. The newIOWitness function must have no 
externally-observable side-effects. Furthermore, we cannot allow 
an Ord instance or any ordering of IOWitness values. 

4.1 Implementation 

Open witness declarations, like other top-level initialisers, can be 
written using unsafePerformlO, but care must be taken to ensure 
that the initialiser (newIOWitness) is run only once. In GHC, we 
can use the NOINLINE pragma. Thus 

identifier :: type <— newIOWitness 

becomes 

identifier :: type 

{-# NOINLINE identifier #-} 

identifier — unsafePerformlO newIOWitness 

However, we don't need to actually run newIOWitness. We can 
instead have the compiler create its own static witnesses. For in- 
stance, we can hash unique names. For a given package P and 
module M, the nth witness declaration 

pat :: type <— newIOWitness 



becomes 

pat :: type — MkOpenWitness 

(tolnteger (hashString " P : M") + n) 

A stronger hash function could also be used if necessary. 
4.2 A Safe Typeable 

The Typeable class in Data. Typeable is unsafe: it allows one to 
create unsafe Coerce: 

newtype Thing a = MkThmg {unThing :: a} 
instance Typeable (Thing a) where 
typeOf _ = typeOf () 

unsafeCoerce :: a — > 6 
unsafeCoerce a = 

unThing $ fromjust $ cast $ MkThmg $ a 

This is unavoidable if Data. Typeable is to allow its users to create 
instances of Typeable for their own types. 

With open witness declarations, however, we can define a safe 
Typeable class. But we only implement the representative func- 
tionality of Data. Typeable: our approach avoids TyCon and in- 
trospection into the internal structure of types. 

A naive approach is to make our TypeRep type IOWitness, 
and so require a witness declaration for each instance: 

class NaiveTypeable a where 
naiverep :: IOWitness a 

This however requires a new instance declaration for each and 
every type that one wishes to use. For example, types such as Int, 
[Char], [Maybe [Bool]] and so forth would each require a separate 
instance. What we would prefer is an instance declaration only 
for each defined type and type constructor: declarations for [] and 
Maybe as well as Int, Char and Bool. So instead we create a 
TypeRep type: 

data TypeRep t where 

SimpleTypeRep -.-.IOWitness t — > TypeRep t 
Apply TypeRep :: 

TypeRep! p — ► TypeRep a — ► TypeRep (p a) 

And here is our Typeable class: 

class Typeable a where 
rep :: TypeRep a 

Is TypeRep a representative as defined in section 2.6? Actually, no, 
as we cannot guarantee that two values of the same type have the 
same value. But it is a simple witness type: 

instance Simple Witness TypeRep where 

matchWitness 

(SimpleTypeRep wa) (SimpleTypeRep wb) — 

matchWitness wa wb 
matchWitness 

(ApplyTypeRep tfa ta) (ApplyTypeRep tfb tb) = do 
MkEqualType <— matchTypeRepl tfa tfb 
MkEqualType <— matchWitness ta tb 
return MkEqualType 
matchWitness-- — Nothing 

We can use this fact to define the required cast and gcast: 

cast :: V a b. (Typeable a, Typeable b) => 

a — > Maybe b 
cast a = do 

MkEqualType :: EqualType a b <— 
matchWitness rep rep 

return a 
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gcast :: V a b c. (Typeable a, Typeable b) => 

c a — > Maybe (c 6) 
gcoisi ca = do 

MkEqualType :: EqualType a b <— 
matchWitness rep rep 

return ca 

We still have TypeRepl to define, to witness types of kind * — > *. 
Our scheme obliges us to choose a finite set of kinds, and define 
a TypeRepX type for each one. For simplicity, we'll pick the 
set {*, * — > *, * — > * — > *}. We do not include, for instance, 
(* — > *) — > *, though this is the kind of our Any type. 

data TypeRepl (t :: * — > *) where 

SimpleTypeRepl :: 

/OMtoess (i ()) -> TypeRepl t 
Apply TypeRepl :: 

TypeRep2 p — > TypeRep a — + TypeRepl (p a) 
data TypeRep2 (t :: * — > * — > *) where 
SimpleTypeRep2 :: 

JOMiness () ()) -> TypeRep2 t 

We can now create some instances for our types, both of kind *, ... 

witChar :: IOWitness Char <— newIOWitness 
instance Typeable Char where 

rep = SimpleTypeRep witChar 
witlnt :: IOWitness Int <— newIOWitness 
instance Typeable Int where 

rep = SimpleTypeRep witlnt 

— etc. 

...and the higher kinds: 

witList :: IOWitness [()] <— newIOWitness 
instance Typeable a => Typeable [a] where 
rep = 

Apply TypeRep 

(SimpleTypeRepl witList) 
rep 

witFn :: IOWitness (() — > ()) <— newIOWitness 
instance (Typeable a, Typeable b) => 

Typeable (a — » 6) 
where 
rep = 

J 4pp/yT?/pe.Rep 
( Apply TypeRep 1 

(SimpleTypeRep2 witFn) 
rep 

) 

rep 

— etc. 

The Dynamic type is easy to define: 

type Dynamic — Any TypeRep 
toDyn :: Typeable a => a — > Dynamic 
toDyn a — MkAny representative a 
fromDynamic :: 

Typeable a => Dynamic — > Maybe a 
fromDynamic (MkAny wit a) = do 

MkEqualType <— matchWitness wit representative 

return a 

fromDyn :: Typeable a => Dynamic — > a — > a 
fromDyn dyn def — 

fromMaybe def (fromDynamic dyn) 

For dynApply, we need to examine the TypeRep in the first ar- 
gument, and verify, firstly, that it represents a function type; and 
secondly, that the type of its argument matches the TypeRep of the 



second argument. The rest just falls into place thanks to the type- 
checking magic of MkEqualType. 

dynApply :: 

Dynamic — + Dynamic — > Maybe Dynamic 
dynApply 

(MkAny (ApplyTypeRep 

(Apply TypeRepl (SimpleTypeRep2 witFn') rx') 
ry 
)/) 

(MkAny rx x) 
= do 

MkEqualType <— matchWitness witFn witFn' 
MkEqualType <— matchWitness rx rx' 
return (MkAny ry (f x)) 
dynApply _ _ = Nothing 

4.3 Extensible Data-Types 

The expression problem concerns the ability to extend types by 
adding new variants, and to create new functions on such types 
which can then be extended with new equations for the new vari- 
ants. 

The first part of the expression problem is the ability to add 
variants, and so first we must discuss what we mean by variants. 
For Haskell, a variant is normally considered as a constructor in 
a data-type. But our modest extension doesn't allow anything so 
fancy as to declare new constructors to existing data-types. 

Instead, we consider virtual constructors. A virtual constructor 
is a pair of functions that do the work of a constructor, more 
specifically, of a single- argument constructor. 

A constructor of a data-type D with a single argument of type 
T does two things. One is to construct, by acting as a function 
of type T — > D: indeed this is the type of such a constructor 
when considered as a function. The other is to match, that is, to 
examine whether or not a given D has that constructor, and if so, 
to obtain the contained T. This we can represent as a function of 
type D — » Maybe T. A virtual constructor, then, is simply a pair 
of functions we call construct and match. 

construct :: T — > D 
match :: D —> Maybe T 

We have two constraints on the functions. 

• construction: a given T constructed as a D matches to the 
same T: 

match . construct — Just 

• uniqueness: if a given D matches a given T, it will be con- 
structed as the same D: 

fmap construct (match d) = Just d (or) Nothing 

What we want is an extensible data-type: some type D we can 
define in module Ml, and later, given any type T, define a virtual 
constructor of D for T in module M2. 

We can do this with open witness declarations. Our D is just a 
value with a type witnessed by IOWitness. 

module Ml where 

type D — Any IOWitness 

For M2, we declare a witness witr for T, and use it to match 
values inside the D. 

module M2 where 
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import Ml 

import (elsewhere) ( T) 

witr lOWitness T ^— newIO Witness 
constructr :: T — > D 
constructr t — MkAny witr t 
matchr :: D — + Maybe T 
matchr (MkAny wit x) — do 

MkEqualType <— matchWitness wit witr 

return x 

Let's verify that the constraints are satisfied. Firstly, the construc- 
tion constraint: 

LHS = matchr ■ constructr 

— A t — > matchr (constructr t) 

— A t — > matchr (MkAny witr t) 
= A t -> do 

MkEqualType <— matchWitness witr witr 

return t 
= A i -» do 

MkEqualType <— Jwst MkEqualType 

return t 

— A i — > return t — Just — RHS 

And the uniqueness constraint: 

a! = MkAny wit x 

LHS = /map construct (match d) 

— fmap constructr (matchr (MkAny wit x)) 

— fmap constructr 
(do 

MkEqualType «— matchWitness wit witr 
return x 

) 

= do 

MkEqualType <— matchWitness wit witr 
return (constructr x) 
= do 

MkEqualType <— matchWitness wit witr 
return (MkAny witr x) 

— Nothing (or (if wit = witr)) do 
MkEqualType <— matchWitness wit wit 
return (MkAny wit x) 

— Nothing (or) Jtisf d = RHS 

4.4 The Expression Problem 

We can consider the expression problem as a diamond-shaped 
pattern of dependency. 

1 . define type D 

2. given type T, extend D with variant on T: 

constructr :: T — ► D 
matchr D — > Maybe T 

3. given type i?, declare function / of type D — > _R 

4. given function /t :: T — » iJ, define result of /. constructr 
tobe/V. 

Here points 2 and 3 depend on point 1, and point 4 depends on 
points 2 and 3, forming the diamond shape. 

The unit of dependency in Haskell is the module, but Haskell 
has a sensible rule that added modules cannot change the behaviour 
of existing modules. [3] This means point 4 cannot be effective in a 
separate module, it must be in the same module as either point 2 or 
point 3. Let's consider each case. 

We can put point 4 with point 3, defining the result when we 
declare the function, and define modules Ml, M2, M3, each 
importing the previous modules: 

• in Ml, define type D 



• given T, in M2 define variant (constructr, matchr) of D on 
T 

• given R and f T :: T -> R, in M3 define / :: D -> i? with 

/ . constructr = /t. 

To solve this with our open witness declarations, with virtual con- 
structors taking the role of variants, we use our the extensible data- 
types solution in the previous section for points 1 and 2. For point 
3, we define / by applying matchr to its D argument to determine 
if it is the variant, and then give the appropriate result. 

module M3 where 
import Ml 
import M2 

import (elsewhere) (R, fr) 

f :: D - R 

f d = case matchr d of 

Just t — + fr t 

Nothing — » undefined 

Alternatively, we can put point 4 with point 2, defining the applica- 
tion when we declare the variant. Again, each module imports the 
previous modules: 

• in MM1, define type D 

• given R, in MM 2 define / :: D -> R 

• given T and fr :: T — > i?, in MM3 define 

constructr T — > D 
matchr ■■ D — > Maybe T 
such that / . constructr = /t- 

If MM1 and MM 2 were joined into a single module, so that we 
knew about the function / when defining our open type D, the 
obvious approach would be to include / directly in D: 

dataD = MkD 
{ 

variant :: Any lOWitness, 
f ■■■■ R 

} 

Here the result of / on the D is stored in it directly. This approach 
is very similar to the virtual method table in C++, where objects 
carry pointers to tables of functions, known as methods. 

But since MM1 and MM2 are separate, we need a way of 
adding arbitrary functions of different types to D. The solution is, 
essentially, an open method table. 

module MM1 where 
type D — IOOpenDict 

In MM2, we create a witness wit; for /, and define / to look up 
the witness in its D argument's method table. We don't care if it 
returns undefined if the witness isn't there. 

module MM2 where 
import MM1 
import (elsewhere) (R) 

witf :: lOWitness R ^— newIOWitness 
f D - R 

f d = unjust (openDictLookup witf d) 

For MM3, we're given a type T and a method function fr of type 
T — > 7?. Our constructr function creates a D with a single entry 
in its method table, that is, ft t for key witf. 

module MM3 (constructr , matchr) where 
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import MM I 
import MM 2 

import (elsewhere) (T,/t) 

witr :: lOWitness T +— newIOWitness 

constructr T — > D 

constructr t = openDictFromList 

[MkAny witr t, MkAny witf (fr t)] 
matchr " D — » Maybe T 
matchr d — openDictLookup witr d 

Let's check that /. constructr = fr- 

LHS = / . constructr = A t — » / {constructr t) 

— A f — > unjust (openDictLookup wit] ( 
openDictFromList [MkAny witr t, MkAny witf (fr t)] 

)) 

= A t -> uraJnsi ( Jwsi (/r *)) = /t = RHS 

We also need to check that (constructr , matchr) is a virtual 
constructor as defined in the previous section. The construction 
constraint holds straightforwardly: 

LHS = matchr ■ constructr 

— A t — > matchr (constructr t) 

— A i — > openDictLookup witr (openDictFromList 
[MkAny wit T t, MkAny witf (fr t)] 

) 

= A i -> Just t = Jwsi = RHS 

The uniqueness constraint also holds, but only because we cleverly 
hid witr inside MM 3. For matchr d to match, d :: D must 
contain an entry for witr - But since witr is hidden, the only way 
to create such a D is by using constructr- 

LHS = fmap constructr (matchr d) 

If d does not have a witr: 

— fmap constructr (openDictLookup witr d) 

— fmap constructr Nothing — Nothing — RHS 

If d does have a witr, then we must have been created by 
constructr- So there must be some t such that d = constructr t. 

— fmap constructr (matchr (constructr t)) 

— fmap constructr (Just t)) 

— Just (constructr t) = Just d = RHS 

4.5 COM-Style Interfaces 

We can use open witness declarations to implement a style of OO 
programming similar to Microsoft's Component Object Model: 

• there's a single type that any object can be given 

• objects can be defined to implement interfaces (set of functions) 

• given such an object, one can query it to find out whether it 
supports a given interface 

• new interfaces can be defined 

For a Haskell implementation, an interface might typically be a 
datatype with a list of member functions. However, we will allow 
any type to be an interface. 

data IDrawable — MklDrawable 

iDrawableBoundsRect :: IORef (Int, Int, Int, Ini), 
iDrawablcDraw :: Graphics — » 10 () 

Our strategy will be to declare a witness for each interface defini- 
tion. 

iDrawableWitness :: 



LOWitness IDrawable <— newIOWitness 

We want to present a corresponding query Inter face function to 
query objects for interfaces. One difference from COM is that 
our interface types are purely that: they provide no access to 
any underlying object and so cannot be used as an argument to 
query Interface. Since our base object type is not an interface, we 
call it Unknown instead of IUnknown. If we wanted to match 
COM behaviour more closely, we could correspond the COM in- 
terface "IWidget" to the Haskell type (IWidget, Unknown), but 
here we'll leave that. 

This is straightforward to implement: Unknown is simply 
IOOpenDict: 

type Unknown — IOOpenDict 
querylnterface :: 

lOWitness i — * Unknown — ► Maybe i 
querylnterface = openDictLookup 

We shall also need a function to construct objects from interfaces: 

newUnknown :: [Any lOWitness] — » Unknown 
newUnknown — openDictFromList 

For example, consider a checkbox control for a user interface, for 
which we want to provide three interfaces. 

• IDrawable 

• IClickable 

• IBooleanState (checkbox is either checked or unchecked) 
Those interfaces come with corresponding witnesses: 

• iDrawableWitness 

• iClickableWitness 

• iBooleanState Witness 

We should already know how to implement the interfaces for our 
object, and we can package them together into an Unknown using 
newUnknown: 

newCheckBox :: 10 Unknown 
newCheckBox — do 
return $ newUnknown 

[MkAny iDrawableWitness drawable, 

MkAny iClickableWitness clickable, 

MkAny iBooleanState booleanState] 

4.6 Prototype-Based OO 

Prototypes are an approach to object-oriented programming that 
erases the boundary between classes and objects. Instead of classes, 
any object can act as a prototype for creating similar objects. It's a 
very dynamic sort of typing, so we'll have to do most everything in 
the 10 monad. 

• A single clone operation replaces these operations from class- 
based OO idioms: 

■ creating a new instance (class — » object) 

■ subtyping (class — » class) 

■ cloning (object — > object). 

• New fields and methods can be added to existing objects, which 
can be looked up by name. 

• New empty objects can be created. 

For our implementation of prototypes in Haskell, we don't distin- 
guish fields and methods: they are both simply members, a method 
being just a member that happens to have a function type. Members 
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of objects are referred to by member name, and these are typed to 
match the type of the member. Our objects are mutable dictionaries. 

type PObject = IORef IOOpenDict 

We use 10 Witness values for member names, each declared with 
a top-level call to newIOWitness. When applied to an object, 
member names act as keys to a dictionary holding the state of the 
object. 

type PName = 10 Witness 

Since objects in prototype-based programming are mutable, re- 
gardless of implementation our Haskell equivalents cannot be con- 
structed, they can only by created within our execution monad. Cre- 
ating new empty objects is straightforward, we simply create a ref- 
erence containing an empty dictionary. 

newF 'Object :: 10 PObject 

newPObject = newIORef empty OpenDtct 

Likewise, cloning an object is no more than copying its state: 

cloneP Object :: PObject -> 10 PObject 
clonePObject pobj = do 

state <— readlORef pobj 

newIORef state 

Reading and writing member is also straightforward. lookupMernber 
looks up the name in the dictionary. readMember does the same 
thing, but fails if the method is not found. 

lookupMernber :: 

V a. PName a -> PObject -» 10 (Maybe a) 
lookupMernber member object — do 

diet <— readlORef object 

return (openDictLookup member diet) 

readMember :: 

V a. PName a -> PObject -> 10 a 
readMember member object = do 

ma <— lookupMernber member object 
case ma of 

Just a — > return a 

Nothing — ■> fail "member not found" 

Our writeMember function is also used to add new members to 
objects. 

writeMember :: 

V a. PName a -> a -> PObject -> 10 () 
writeMember member val object = do 

diet <— readlORef object 

writelORef (openDictAdd member val diet) 

Invoking member functions must be done in the 10 monad, since 
members are mutable in objects, and we run the risk that the mem- 
ber isn't in the object. Member functions must generally include an 
argument for the object itself, so that when an object is cloned, the 
method is used with the new object rather than the old. To simplify 
method invocation, we can create an idiom for methods, that their 
types should have a particular form: 

type PMethod a r = PObject — ► a — > 10 r 

We provide a function to make invocation slightly simpler: 

invoke :: V a r. PName (PMethod a r) — > PMethod a r 
invoke name object args = do 

m <— readMember name object 

m object args 



While the hierarchies of class-based idioms model strict IS-A re- 
lationships, prototypes are good for more vague IS-LIKE-A rela- 
tionships. For instance, an ellipse is like a rectangle. Here we first 
create a prototype rectangle: 

wihounds '■■ PName (Int, Int, Int, Int) <— 

newIOWitness 
witdraw :: PName (PMethod Drawing. Graphics ()) <— 

newIOWitness 

rectangleDraw :: PMethod Drawing. Graphics () 

rectangleDraw obj graphics = do 

(left, top, right, bottom) <— readMember witbounds obj 
Drawing. drawRect graphics left top right bottom 

makeRectanglePrototype :: 10 PObject 
makeRectanglePrototype = do 
rectangleProt <— newPObject 

writeMember witbounds (0, 0, 100, 100) rectangleProt 
writeMember witdraw rectangleDraw rectangleProt 
return rectangleProt 

Then we clone it and modify the clone to make a prototype ellipse. 

ellipseDraw :: PMethod Drawing. Graphics () 

ellipseDraw obj graphics — do 

(left, top, right, bottom) readMember witbounds obj 
Drawing. drawEllipse graphics left top right bottom 

makeEllipsePrototype :: PObject — > IO PObject 
makeEllipsePrototype rectangleProt = do 

ellipseProt *— clonePObject rectanglePrototype 
writeMember wit draw ellipseDraw ellipseProt 
return ellipseProt 

Finally we can use these prototypes to create instances (which are, 
in fact, just clones): 

makeShape :: 

PObject -> (Int, Int, Int, Int) -> IO PObject 
makeShape prototype bounds = do 

shape <— clonePObject bounds 

writeMember witbounds bounds shape 

return shape 

main = do 

rectangleProt <— makeRectanglePrototype 
ellipseProt <— makeEllipsePrototype rectangleProt 
myCircle <— makeShape ellipseProt (50, 200, 30, 30) 
myRectangle <— 

makeShape rectangleProt (80, 200, 60, 30) 
graphics <— Drawing, new Window 
invoke witdraw graphics myCircle 
invoke witdraw graphics myRectangle 

4.7 Thread-Local Storage 

Peyton-Jones [10] suggests a language extension for thread-local 
storage. It consists of a new top-level declaration, newkey, and 
two functions, withBinding and lookupBinding . 

newkey (identifier) :: Key (type) 
withBinding :: Key a — > a — > IO b — > IO b 
lookupBinding :: Key a — > IO a 

Our open witnesses extension cannot do thread-local storage by 
itself, but by doing the Key work of dynamic typing, it can reduce 
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the necessary API to a single function that gets a single thread-local 
object, an IORef to an IOOpenDict. 

lookupDict :: 10 (IORef IOOpenDict) 

This IORef is initialised at thread creation with an empty dictio- 
nary: 

newIORef emptyOpenDict 

We can then implement the suggested thread-local extension. A 
Key is simply an 10 Witness. 

type Key = IOWitness 

And top-level newkey declarations become top-level 10 Witness 
declarations. Thus 

newkey identifier :: Key type 

becomes 

identifier :: Key type <— newIOWitness 

The lookupBinding function calls lookupDict to fetch the key: 

lookupBinding key = do 
dictref <— lookupDict 
diet <— readlORef dictref 
return (unjust (openDictLookup key diet)) 

The withBinding function executes a function with a new binding 
added to the binding dictionary. It then restores the old dictionary 
when it's finished. 

withBinding key a foo — do 
dictref <— lookupDict 
bracket 
(do 

diet <— readlORef 

writelORef dictref (openDictAdd key a diet) 
return diet 

) 

(writelORef dictref) 
(const foo) 

5. Related work 

Several different approaches have been proposed to solve the ex- 
pression problem in Haskell: 

• Data. Typeable [1] is a popular solution to this problem, avail- 
able in the standard libraries. But it is unsafe (section 4.2), and 
therefore ugly: by writing an instance of the Typeable class, it's 
easy to write unsafeCoerce. 

• Weirich [17] presents RepLib, a library for representing the in- 
ternal structure of types. But that means breaking their encap- 
sulation. 

• Loh and Hinze [7] offer an extension to Haskell of open data 
types and open functions. This is clean and intuitive to use, 
powerful, and safe, but it involves a translation from their ex- 
tended Haskell to existing Haskell that requires modules to be 
compiled together. 

• Seefried and Chakravarty [13] also offer an extension to Haskell 
of open data types and open functions, that allows separate 
compilation, but with a translation that is considerably more 
complex. 

• Swierstra [16] has a scheme where types can be easily con- 
structed from a given list of variants. But new variants cannot 
be added to existing monomorphic types. 



6. Further work 

6.1 Multiple Dispatch 

In section 4.4, we showed how to do single dispatch, that is, create a 
function on a single open type that can be defined for new variants. 

The programming language Dylan allows multiple dispatch, 
that is, functions that dispatch to particular methods based on the 
type of more than one argument. This is also a notable feature of 
the Haskell extension proposed by Loh and Hinze [7]. Can this be 
done in Haskell with open witness declarations? 

6.2 Top-Level Declarations 

The mechanism we proposed to declare open witnesses at top level 
is to call one particular IO function {newIOWitness) as a static 
initialiser. This could be generalised to declare top-level MVars, 
IORef s, and so on. Care needs to be taken, however, to prevent 
observation of the order in which initialisers are executed. 

On extending Haskell with static initialisers there has been ex- 
tensive discussion on the Haskell mailing list since at least October 
2004 [8], mostly in the context of global variables. Hey et al. [5] 
summarise this on the HaskellWiki web site. 
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